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laculty, ad";inir>trat.ors , ID sLalf, and );raduatf: j^tudents involved in 
in^tructri pual devc lu[)r.ent within hU;lier education generated and ranked 
tactors in^trurental in the successful operation of Instructional Develop- 
iru-nt Centers (IDC). Twenty factors were selected, then rated in order of 
perc/'lved Ir^porbh^nce and ability to be manipulated by the admin ;s t;?iH:ifm^- 
and byj/iu» IDC* Results indicated in this initial study that factors re^at- 
eCK to adudnistratiun (bud^;ctary support, placement of the IDC in t,he 
hierarchyv and rewards' t1^ faculty); and to the IDC (skills of staff and ^ 
direcKpr) Are better ipdica^rs of success than factors related to IDC , / 
inage and faculty skills. TkKJactors that facilitate ID appear to devoly^ 
trbm the ''concerns" of the indiv^^al rathet\than the position he/she ho/ds. 
The inodel cK:rived from this analysKi provides a patadigir. for dlicisi^n-p^king 
in the establishment, operation and p^motion of instructional deVeioi^J^tsnt 
within the institution. 
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INTRODUCTION 

■ / . A • 

Over the past ten years systems models of the instructional ^development 

\.,^ 

process have- proliferated almost at computer speed. No longer are these models 
the sole property of ^the educational technologist. At every level of educa- 
tion from kindergarden to higher education, administrators,* teachers and even 
8l;u4^>nt:3 are attempting to define teaching and'learning activities in terms of 

systems models. Despite the somewhat inconclusive research evidence on the 

\^ m 

effectiveness of instructional devj^lopment, many institutions have attempted 

to implement th^ process in order to encourage innovative alternative programs 
or to improve existing programs. *f 

Two of the most commonly used systems models for instructional develop- 
ment (ID) have been the product development model and the organisational .model. 
The- ID product development model has been mosf'USeful to the instructional 
dcvelpper in giving guidance on defining instructional components such as 
performance objectives, pretest, instructiohal activi,tie9 and/ res*^rces, 'post- ' 
tests and revision* of products and^ procedures based on empiric'STT evid^ce. 
The second type <^ model provides Information on organizatio\ial procedures in 
Xmplemonting curricular and ID se^ices within |tn^titutionsv\. These models, 
havv^every are most often based on infomation and' organizational processes 
commonp only to the institution at which the luodel was developed. The models 
are more concerned with hierarchial structures arid direction of authority or 
activity, and do not address th^ms^elves to the complex factors related to 
success or failure of instruct;ional development programs. 

Research is necessary into the^^^4*^veiop5i^nt of a third^typ^ of instruc- 
x^ional development models: one* that can define a§ well as demonstrate relatlon- 
sihi^s between factoijs that will facilitate successful ID efforts within higfi^T. 
^tion^ . \ - 
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Several real problems in the development of such a mokel afe immediately 
apparent. First, much of the information generated to dat|'e has been purely 
anecdotal. Success factors deemed imprtant in one given cjontext, may not be 
appropriate or usi^ful in another institutional setting with different admini-^ 
strativej faculty, staff and student populations. 

\ ; 

Besides 'this lack of generalizability between*contektual settings, a ' 
second problem is in the definition of specific success^ factors or vari^lxles 
Each person involved in the ID process has a different perception of (those 
^variables that are important. Those factors gene^ted^y developers Aone 
, tend to stress their concerns for the purity of preserving their own ID " 
V^ocedures. Moreover, producers are concernedf about\/ resources , staff arid 
equipment; faculty are concerned about thet^-own academic control, time, and 
rewards; administrators are^concerned about productivity and accountability 
of both their staff and resources; and all are concerned about their respec- 
tive financial support. In order to develop a model t^iat can examine all 
aspects it would be necessary to have success factors generated from all 
groups|^nvolved in the ID process. These' nuiTW3>j|ous factjors would need to be 
restated, and similar factors consolidated into terminojlc 
groups. . . ^ ^ , 



.A third problem in the develo|>nvent of a modql relat 



relationships that exist between factors. Administrative support of an ID 



Igrvter, for example, is closely rela^ted to th^-total bud 



ogy common to all 



es to the inter- 



^etary suppiort given 



to the Center, ^riy model that might be produced, therefore, shoAild be ablie 
tD show the relationships between' factors, as well as th<sir influence upon one 
another. 

In summary, data needs to be obtained from a wide variety of subjects 
involved in instructional deveiopmen^t within higher education iti order to de- 
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fine ancll assess the factors that are considered crucial to the organization of 
ID programs. Such input could then hk utilized to demonstrate the inter- 
relationships between factors and their ,r,elative importance within existing 
organisational structures. The resulting model could then be used by iu staff 
or administrators t;o optimize or facilitate ID efforts within their own 
organizational conteJ^t. 



REVIEW OF LH^^TURE ON INSTRUCTIONAL DEVELOPMENT MODELS^ ' 



A. The Instructional Dev^^lopment Process 

One of the most compre\iensive surveys of procedures and models of system- 
-atic educational development is provided by Baker (1973). Baker cites the 
work of development theorists ^uch as Banathy (1968), Borg & Hood (1966), 
Briggs (1970), Glennan (1967) / Gilbert (1962), Glaser (1966a, 1966b), ^ 

Johnson (1969), Mager & Beach (1967), McNeil (1968), Popham & Baker (1971), 
Schutz (1970), and Stowe (1969). New texts on the systems approach in the 
development of J^sti^uctioaal ma^terials inclu^ijer books by Davies (1^710, Baker 
&\Schutz (1971), Davis, Alexander and Yelon (197A) , Gagne & Briggs (1974) and 

\ \ 

Gerlach ^^&,^^y (1971). ^asically inmost instruc»tional developers detail proced- 
^s^vThich includ^ the specification of behavioral objectives, pretests, ♦ 



selection oT~?^tructional activities, resources and environments, posttests, 
and the revision of materials or procedures on the basis of empirical data. 

Baker (1973) makes a clear distinction between instructidnal prodm;^ 
develo>;nent and the "change support process" (p . 251) . Product development 
focuses interest on the development of specific materials, while the change 
process' orientation foc^usies on people and organization within education. 
Schutz - (1970) has argued for a merger of the two approaches in order to ensure 
that validated instructional products gain entry into ongoing educational 



organizations. Baker (1973), hawever, notes that procedures for "chinge sup- 
port involves comprehensive question of organizational change, and various 
forms of innovations have idiosyncratic support requirements'' (p. 252). 

Research into Instructional Development 

\ 

sWth and Murray (1975) conclude their study (^^the status of research 

models o\nroduct development with the statement thatvthere is practically 

no solid empirical evidence to justify the prescriptive Vse of development 

and evaluation models in instructional product deve^-opmentN,^ (p. 17). The" 

same ^onclusilc^ is made by Helwig (1974) who also suggests that educational 

technol^y address itself to the whole educational system of people and 

organization, rather than to hardward and products alone. 

Baker (1973), despite extensive research in the field herself, looks 

( 

"forward to writings which did not jprescribe, on the. basis of faith alone, 
legions of procedures" (p. 277). She too suggests that inquiry is needed 
into procedures that are successful within particular drganizational contexts. 

Despite the lack of conclusive hard research evidence, whether by "faith 
alone", by intuition, \pr by exper^i^ce with successful practical applications, 
educators are proceeding with instructional development activities on their 
campuses, ^search must continue on the ID process to achieve more opera- 
tional 4efinitions of concepts and variables, and develop more effective 
tools to^ measure the effect of the process . upon both the learner and the 
teacher. At the same time, however, study must* be made into the complex 
task of facilitating ID efforts into the organizational structure of insti- 
tutions of higher education. 

C. Recommendations for Success in Instructional Development 

Recent literature on instructional development programs in higher educa- 

6 
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tion Vindicates som^ degree of consistency in advice from various' sources. 
The following success factors are listed in the ordej Of their appatent 
J.mportance as evidenced by the frequency of their mention within the public- 



ations reviewed^ , ' * ( 

V 

1. Committment by the institution . This general 'factor wa^ discussed 

by the majority of authors as essenti^ in^ the establishment ofr an effective 

\ ^ 
program of instructional development on campus. Both Diamond (197A) and 

Purdy (1975) state that the administration is responsible for the coinmunica- 

tion 6n camj^u^ of problems and the need for changeV^^ Whitefield and Brammef 

(1973), DeBloois & Alder (1973)/, and L^e (1971) all stress that tHis support 

must be forthcoming from eithe^- the presid^t or provost in charge of 

\ / * / 

academic affairs. The creation of an *'innovational climate" by administra-- 

/ ■ \ 

tion is also s^tressed bj/Alexander & Yelon (1972), Diamond (,1975), Lee (1972) 
and Purdy (1975). 

Commi&rment by the administration, however, is measured by mii^st a-uthors 
in^ terms of budgetary Support for ID Centers: De^Bloais & Alder (1973); 

Diamond (1975)\ Lee, (im, 1972); Popham (197A); Stowe (1971); and Whitefield 

\ \ . 

& Bramnier (1973). This specific factor is clearly the ^nost frequent sticcess 
variable cited by those ID Centers canvassed by Alexander and Yelon (1972). 

Another indication of administration's committment which appears to ef- 
feet the succe^ of ID programs is the position of the ID Center within the 
hierarchy of , /he institution. In reporting on fifteen ID Centers currently- In 
operat\on throughout North America, Alexander & Yelon (1972) report tha.r'^he 
majority Vere operated from ^' central position, whereas the remaijider were 
operated within individual ^Colleges or Departments. Diamond-f 1975) stresses 

the^^ecessity for ID services to be controlled centrally with decision-making 

r , « X 

policies be/ing made at t"he Yi'Ce- Presldejritial lev^T where communication is 

\. 
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clearly defined b^t\^e^nj:^legi^s and Departments. Lee (1972) also argues that 
the director shouL^not only be given academic rank equal to faculty colleagues,- 
but alsp'^shoui^^ave the power to make policy decisions in relation to the ID 
projects urWer development^-'^'^n describing their owri ;;>per^tions , four of the fif- 
teen Centers in the Alexander and Yelon study specifically mentijpn tlie position 

■ ,. * • 

of 4;he ID Director in the Administrative hierarchy as ^n essential factor. 

2. Faculty Rewards . I'he current reward structure in existance, partic- 

ularly. at oldl|P»istitutions of higher education, has had a strong neg^tive^in- 

fluence upon efforts to improve teaching and learning. Benston^^473) repeats 

the common argument that faculty are rewarded for research not for teaching. 

Good teaching he argues, does bring a certain level of prestige to the profes- ' 

sor, buV'instead of positive reward, a good teacher find^ the work load'^is in-.- 

creased wH^n improvement efforts are undertake. Benston, as well as all other 

» - < * 

authors reviewed, stress the importance of providing incentive for impovement 4* 
in teaching through changes in current out-dated standards for promotion, merit, 
tenure, release tiirte, etc. . 

3. ^ Skills of the ID Staff . The first success factor which is related j?o 
the ID Center directly appears well down the list, after the above two facTTors 
related to the administrative structure of the campus. The^^^st important in- 
ternal factor described by most authors rela^feefe directly to the range and quality^of 
the professional skills available to f'aculty at the Center. Specif ic. skills 
mentioned by authors ranged from personal dynamics skills sucb as diagnosis of 
personal needs and counseling; skills required to move through th^ ID process 

such as the definition of goals, selection of strategies etc; technical skills 
.related to the design, production and implementation of instructional materials? 
and skills related to the evaluation of needs, people, materials ^nd programs: 
Alexander & Yelon (1972); DeBloois SI Alder (1973), Diamond (1975), Lee. (1972) , . 
Lindquist (1975)"r>ur^y^(1974) , and l^Thitefield & firamiafer (1973) . 



4. Resources" and Facilities , Closely related to the "human'' resources 
noted above, most of the same authors cite the need for physical resouifces and 

__f acilities . These include office, library and media res6urces (both hardware 
and software) necessary for'the de^sign, pro3ilct4on, implementation and evalii- 
ation of new teaching resources and programs. 

5. Evaluation pf Programs . A smaller number of authors st«ss the need 
•for programs of evaluation. Diamond (1974) sees evaluation not only aHsa part 

of the revision cycle, but also .stresses a type of evaluation at the **front 
'» He calls fgr-both administration and the Center to have clearly identified 

goals and objectives ,presutHably to give guidance in the selection of development ^*^ 
projects, as well as to provide a yardstick against which to measure the final 
effect of the program under, development. Popham (1974) stresses the need for 
focusing of student, achievement reWults as a means of getting at the complex and 
difficult task of measuring teachipW effectiveness . Both Kee (197i) and 
Lindquist (1974) cite overall program evaluation as another essential consideration. 
In the review of ID Centers by Alexar^A^^ and Yelon, several Centers list evalu- 
ation of-'-ongoing programs a^ at key fai^ti^l-, and stress the need for consistency 
in eyaluation-procedtrres , 

6. Faculty Openness to Change . Th^ ^ron evidence of the efficacy of 
this factor is found in the Alexander and Ye^lon book. At least nine of the fif- 

■- • . -Vv:. 

teen ID Centers mention the importance of th;i^ factor, making it second only to 
budgetary su4)porl: as a critical factor iti profiting instructional development on 



\ 
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.campus. Lindquist (1974) devotes Ms arliicie AO a consideration of "change 
modcils" useful in .promo tirtg^lnno vat ix)h on the campus. Puf^dy (r975) states di- 
rectly that the faculty ' s -openness to change, wilL seriously effect development 
efforts on campus. Both Lindquist and Purdy, howevier, suggest that unless fac- 
ulty are involved in the charge process that efforts of^ administrators may be 
in vain. ' 



7. Stujient Attitudes . Few articles directly consider the needs of stu- 
dents, -or try to relate their attitudes to the development process. Only two 



itlon ^tK^ Importc 
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of the fifteen Centers In the Alexander and Yelon book mention tK^ Importance 

♦ ^ 

of positive student attitudes. Diamond (1975), however, lists "a relavant cur-- 
ricuium" as a p'rlmary factor. He explains that the curriculum should be ^^^^ 
vant to the present and future needs of the student, as well as to the community, 

/ society, and to existing psychological and social factors. 

8. Fdcus^ of the ID Center . This factor seems to be a concern primarily of 

I those ID Centers that ^ave developed beyond early stages. ' Diamond (1975) ^ 
stresses the need for the ID Renter to focus on large 3clale projects whl)qh uti- 
lize the full range of the ID pro^fess. By selection well planned proj'ectsN^ith 
\ood prospects fqr;success, and by following through on all development phase! 
at a. colleglal of departmental level (rather thag^ais; an Individual of course 
/Xevel), projects have\a better survlvlal chance as vWl as a better chance of 
having a sighif leant e\ffect upon wide group of learners, and faculty. 
In the Alexander, and Yelon book, at least one third of th^ ID Centers inclu^^^ 
list this level of focus as an Important success variable in the operation of 
their ID programs. ' ^ 

/ METHOD ^ * 

Instrumentation ' - 

~ * 

The first step in the determination of factors that facilitate the successful 
operation of an Instructional Development Center was to examine •existij^g opjjii.oil 
as reported in the l^g^ature . Thus, the eight factors listed above we;^derived 
Secondly'^ the opinion of staff students anrf" faculty who knew aboulfl^stluctlonarl 
development was^soughtby a questionnaire (App^ndix^A) sent to thirty j^^^t^fe^t 
several institutions. Ten qu^stlonalre^-were returned.. 

Anaf^teis of this preliminary^^xTata yielded, however, a hi^h degree ofj^ 

10 



consistency in naming variables. Similar factors were combined, reworded, and 
then amalgamated with the abov^ data taken from the literature. A pilot. quest, 
tionnairi exposed of seventeen- factors (Appendix B) was then distributed to 
respondents at two large north-easterpr "universities. Analysis of this second 
round of responses • indicated that'^Jactors related to faculty characteristics 
were too'-limited. Other facj^^s were no't clearly worded or had no clear alter- 
natives.' For example, the issue of long ^nge development projects needed to 
be balanced by a priprity for small projects with quick vturn-a-roud time. 

The final questionnaire contained twenty factors produced by the above 
series af trials and pilots. * Each respondent was ;^sked to m^e three judgements 
about each factor on this final questionnaire (Append>x^^C)^ First, they were 
asked to rank each of the factors in order of^^itnportance from 1 to 20. Second, 
respondents were asked to rate each fagt^ri^ potential -ttr^Te-^ian44>^^ by the 
administration of the institution. .Third, responde ngs were asked „to^ te ^ach^^ 

on its ability to be'^manipulated by the Instriictional Development 

' ■ ■ .■ , 

Cen>^. These last two judg^ements were rated\on a five point scale (1 
''senting maximum^anipulat^on and-S least* manipVlation) . 
Respondents. / - ^ 

' . / , 1 {■, 

" ThB resptyndent^J^^e' graduate' studentB^Jji Ins true ti^nal^^ev^^Ifipm (n=18) , 

Clonal instructional developers (n=12) , together with some faculty (n=8) 

and adMi^istratots (n=2) familiar with instructional development. They were 

arbitrarily cho^^^within two north-eastern unj^^e^^ofg^^ practising 




Jjas^raCtTohal developing 

Data analysis . , 1^ 

The J^hree judgthents made by each res^re^ident .were converted into three 
types/of dependeffrineasures. ; An^^tlalysis was udertak^n separately for each of 
the tVvr^e types of dependent measures. The three types were; 
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(a) the factor ranks; (b) a weighted rank for administration /fianipH^lation pb- 
twined by multiplying the factor icank by its rated manipulation potential; 
and\(c) a weighted rank for instructional development center manipulation ob- 



tainea'^isimilarly. Means for all respondents for each of the three variables 
are found. in Appendix D. - ' ^ 

U^ing an algorithmic technique developed by Ward (1963) and made avail- 
able as aycomputer program (Veldman, 1967; Nielsen, 1975), bo'th the factors 
and tJ^.^espondents were grouped on their responses to ex^mihe similarities 
in res pons e&**^mong people and among factors. Grouping according to^this 
algorithm minimizes^he wi thin-group yariance and uses the measure ofMigtance 



between fai^ctors or respondents' irx^multidimensional space as an index of 



ERIC 



similar j/ty. • ^ . ^ 

Once the groups of respondents were formed on each type of ^dependent 

measure the mean profiles of the groups were/ contrasted. The number of groups 

/ ■ • . 

determined by the algorithm was limited/to four or less in order to facilitate 

Meaningful comparisons in the analyses^. The compositions of the groups, 4 

formed by the algorithm were compared with groups formed by considering the 

respondent's academic rank; a chi-squaTe test of'^ndependence was used. 

Fq/ each factor in turn, the mean rank for each respondent group. vras com- 
pdxed using the modified least significant difference procedure (p=.01)* The 
use of this procedure at the chosen level>if significance was considered appro^- 
priate, and sufficiently conservative since each'f actor only contributed on^ 
twentieth to tfhe group membership. Tb^ use of this statisvtic would becc^e^ more 
.questionably as the i^umber of factors was decreased. ' ^ , 

In Drder to minimize the nnjmber and t^^pes of grouping analyses, the term 
"clustering" will be used to refer to factors grouped according to tke 
algorithm, and the term "grouping" to refer to respondents grouped according 
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the same algorithm. 

, RESULTS. 

■ ■ N.' 

A. Analysis c>^ factor rankings 

!• <^lustex;ing^ the factors: When using the factor ranks as dependent 
measures-, simlar factors, t^^e^ to cluster together according to response 
patterns. Thus,xwithin the twenty factors , ■*«uir^^usters ^ere produce's;^"' 
(Table 1). The four clusters may be broadly characterized as:. (1) ^dministra- 
tive' support factors; (2) instructional developnjent policy f^ictors; (3))^»mpus 



cl'imat^e factors; ^nd (4) IDC imdge factors. These clusters produced throOgh 



the algDjithm described above were then xi^ed as the basis of the^ following 



analyses of the respondents. 



in5ert.Jable 1 about here 



2. G^uping^^ the respondents The responde£Ll^.>wei?e' first grpjXped accorMn^ 



to their academic states: adminis^tftor , faculty, ID pe^sonn^l , andN^ student. 



However, in this 'VaturaJ^Xgrbuping there werkno signif leant . differences%^t- 



|f^en mBan ranks fjir e^t^-f^ttor. Respondents weife then grouped by the. algorithm, 
tills process producedv^ three'^s^^arajtie groups of respondents. Men^ership in 

C was, defined l>y 'the aIgo^^thTTK.as a' similarity in response patterns 



'Group A, B, or 



over tlie twenty factors onv?the qaestionaire., ^-/lien impmbership of ^ algorithm groups 

were compared with status groups no significant trends in membership were appar- 

•: ■ • ^ ^' ' ^ ' I 

eat (ehi-squaire h^6, df=6, p=.53).. Thus, none -of the groups fbrmed by the . 

• ' . ..."..<?, ■ ■ . , . 

,^ algorithm couild be said^to be representative of a particular academix;, 'group, 
^ ^ Mtbough the status group mean ranks on facjors showed no significant differ-. 

/ ^- / ences^ the algorithm groups shpwed Hiff^rences (p=.01) on a number of factors 



"3^4, 6, -12, ^4, 15,48, 20; sV, Tabl 



e 2). 
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Insert Table 2 about here . / 



j5h-xexaMnation of the response plots of the respondents in groups A,B, and 

X \ ■ 

C (Figures i N^Wu&h 4), it can be seen that each group rates one cluster of 
factors more, favol?^!^ thafi the other two. In these four figures the mean facr 
tor ranks on the vert^^laxis represet^t the twenty orig,inal factors, thus the 
lowest mean rank indicated Che most' highly favored factdr V^-^n Figure 1 it is 
evident that those respondent^who favor fae^u^rs related^ to ' the adMivistrative 
\support cluster can be seen as members of a group (B^ that responds consis 
ently. In Figure 2 another group of respondents favor factors^ related to the . 
•ID policy, cluster (C) ; and in Figure 3 a third group of respondents favor fac- 
tors related to the institutional climate cluster (A). In Figure A, however^ 
respondents show, no such Consistency in favoring factors related to campus ID 
'image. W^^h only three factors in this cluster,. it is perhaps difficult to 
obtain ^y overall pattern. . ' 

On the basis of this analysis it can be tentatively' suggested that groups 
formed by the grouping analysis .tend to^ respond on the/t/asis of the values and 
concerns of the f)erson rather than by position anfl function h^^or she holds 

within the organization. Thus, a description oKgroup characteristics by status 

\ . \ 

ippears less useful in dete/rmining the main donceriie of the* membei;s of each , 



group than, description based upon algorithmic grbupi^S- "^^^ latter . allows the 



isolation of art individual member's concerns and also appears to isolat^ the ' 
potential motivating concerns within the university community. 

.* V.............. . ; 



Insert Figures 1 to A about here 
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B. Analysis of ranks wei ghted for administrative manipulation 

1. Clustering the'welghted factors; When using the first weighted 
average as "a dependent variable (factor tank multiplied by the rating for the 
adifiinistrative manipulation! , three clusters of factors were generated by the 
algorithm. These new clusteScis were not dissynilar to those 'clQsters obtained 
under the analysis of the factor rankings. The first clustet involved factors 
related to administrative support and policy; the second cluster involved fac*- / 
tors related to institutionaivclimate; and the third cluster involved factors 
related to both IDG image and faculty skills. 

The clusters appear to groupNarOund traditional beliefs of respondents 
about administration and policies. Thjds, administrators are viewed as being 
more concerned with policy th^ns^Tich institutional^ cJjimate and even less with 
the IDC image and facu.ltt/ skill V^afc^o^rs . In many respects these three cluste^rs 
represent factors th^t range on a ^ontxnuum (central to p,eripheral) of 
administration zoj^c^ns. . ; 

2. Griping the respondents f s>ift)jects we-re grouped ^n \he basis 

of the administrative manipulation weighted .factor r^nks, two tnain groups emerged 



ting any 
an 



(X, n=2l; Y, n=18) . These groups were not composed of the same respondents 5s 
in the pi;evious analysis of' factor ranks; only 50% of eaclT^b^r^p was |royt)ed to- 
gether previously. These groups were again not characterized as represert" 
particular academic status groups (Chi-scj[uare=6.38,\df=6.> p*.383). From 
analysis of the profiles, group Y in this analysis Vas more concerned^ with admin- 
istrative issues than. group X (Figure 5) , while group X was more concerned with 
factors related to institutional climat;e ■'(Figure 6). Although not statistically 
significant, the two administrate;^ "^n -the sample fell in group When the 
respondents were grouped on their administ ration^ ranks three grout)g 

were in fact formed. Gpoup Z,,the third group cont^ln.ed only ond respO'ndent 
whose profile was so di^imilar that he was maintgl|iiad\ in his own group by the 
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algorithm. This respondent (an instructional developer) tenaciously rated 
IDC image 'and faculty s^lls factofs more highly than the other two groups. 
He also rated these same factors more highly than the other two clusters* of 

o 

factors. « . 

As with the previous Analysis the sample can be characterized by its res- 
ponses although tlve mean ranks ef groups X and Y only differed significantly 
on two factors (//// 14 and 18, .p=.01). Group Z differed significantly from both 

g^r,pups X and Y on five factors //// 3, 10, 11, 12, '15) anlk^'rom gro^ip X on two 

* • 

additional factors (itlf 13 and 14'). 



Analysis of ranks weighted- Cor lt)C manipulation. 

1. Glusterihg the weighted factors: When second weighted average was 
used as a dependent vaf iab»le (factor ranls.s multiplied the rating .for the IDC 
•Manipulation), the grouping algorithm produced two clusters of items. One 
cluster might/lTGv termed internal IDC related factors (//// 1, 3, 4, 6, 8, 10", 
11,' 12,' 13,^16, i7, 19); while the second cluster might be termed extei/ial to 

C (ie.\campus wide) factors (///^ 2, 9, 14, 15, '18, 20). This interest- 

ing dichotomy between the two groups refXec1;;s\a distinction easily made by an 





ttuctional developer looking at hi^/her yfenv^ronment or ap ' outsider^ looking 
iou to >4^ Camp^ c o nXe x t . 
2. jCroupingXhe responden^; 

he re^pondenfi^we^e-'grouped' on the basis of their weighted 
ranks, two groups^^re formecl (P, n=31; Q, n=9). /These groups again d^d not 
form on academic status lines (Chi-Square=2 . 1 , df=3, p=.5Z^. Eight members of 
groun we?e included in'group X in the administration weighted rank analysis 
(wit|) the additional member t^ng the renegade from group Z) . Eight members of 
group^ were- also previously include d^^i^roup A in the initial factor rank 
analysis* In both previous analysis the membeT<s of group Q were associated with 
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others that ranked clinuite factors as most implortant. In this analysis gryoup 
Q members tend to favour external factors, hj^ce they might be characterized 
as interest4?d in r^^l^itionships and factbrs outside an IDC. The larger group 

i ' 

P (n^'Sl) mi/ght be characterized as IDC centered. This group is primarily 
interested' in the manner in whicii the center operates and is ^up^orted by the 
administration. Using the modifi^ lea3t significant difference procedure 
(p=,01), significant <^ntrasts between these two groijps were found for six of 
thu factors 'c"^//' 1, -% 9, 10, 11, 14). 



X 



\ 
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DISCUSSION 

The factors' generated through the study appedtred to be adequate to elicit 
specific attitudes? from respondents and were useful in sorting them into groups. 
Further study, JrioWever, is needed on the definition of the factors so as to be 
able t^o place each specifically into definite categories. Each factor also 
needs to b'e re-examined for operational definition. For example, factor //2, 
•'administration' s support of the IDC'* was vague and did not include specific 
refecence- to the nature of support as did //// 12, 15, 20* 

The ifesuTts of this preliminary study suggest a re-evaluation of the common 
conception of thu concern's of va^-ious individuals within higher education about 
instructional development activities. Catagorissation of an individual's 
concerns according to academic status appears to be inadequate. Instead of this 
standard grouping technique, this study seems to indicate a more appropriate 
groj^plng of individuals would be; according to the similarity -of their response 
patterns. It might also be conjectured that identification of these grotips 
might also allow the bringing together of individuals who could Work tagether 
harmoniously to facilitate instructional developnifent pra&ram'fe. » 

Generally, tlvere appear^^^o be thre^^ mirVt jstyles or. concerns^ t:ha*t icfentify 

differ^t groups: first, thos^^conoerned^with administrativ«^support factors; 

»■ * - ♦ ■ 

secpndly, those concerned with instruct4/Gnal development policy factors; and | 

\ . ■ / - *. ■ ^ - 

thirdly, those concerned with institutional climate factors. The weight of 

factors' Je^bryJing upon the degree o^ntanipulability by either administration 

^r\the IDC provided an insight into those factors for which a particular group ^ 

felt responsibility. For example, ^Ithough some group ^fferences were observed 

when ranks were weighted on administrative man^j^ulation, both groups ranked the 

clusters of factoiis related to administrative '^support and ID polic/ higher than 

the cluste.rs of, factors related to climate* -faculty, skills, or JdC image. 
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' \ Future studies should also include more respondents from a wider population 

base representing a wider variety of Institutions, and levels of academic status 

than was obtained in the present sample. However, if the response patterns are ^ 

maintained in subsequent studies, and similat groups are formed, then the ins- 

trument and procedures developed in this study appear to be able to predict 
t 

the types of factors that concern each member of the algorithmic groups 
independent of either the ins titution or the academic status of the respondent. 

The graphic display of a model that can illustrate the inter-relationship 
of factors that facilitate instructional development is most difficult to plot 
at this early stage. Three different rankings were' analyzdti in this study and 
respondents' priorities shifted depending upon their perception of manipulative 
power within the institution. A$ a beginning, the inter-relationships betweien 
factor ranks alone are demonstrated by a systems diagram (Figure 8)1 In this 

. • • • ' ' \ - 

diagram the essential clusters of factors derived frbm the grouping algorithn^- 
are maintained. Arrows between factors indicate .direction'pf influepc-e. The 
changing focus of concerns with weighted ranks (administrativ-e of IDC manipu*- 
lation) is demonstrated by asterisks beside the three most favored factory in 
each category. . . ' * 

While the generalizability of this preliminary model cannot be assured 
at this time, the technique for producing the model seems to haS^e implications 
for assessing attitudes towards instructional development wherever the procedures 
are utilized. By administering the questionaire (Appendix- C) individuals with 
similar "concerns" within the institution ^might be grouped by the algorithm 
technique. Once ^le key factors a^re clustered, mo^^i- Inight b^ produced. Such 
a model could- then account for the inter-relationships of factors as^ they related 
to the specific organizational context of the giVen institution. Besides isolate- 
ing^iigh pl??h^ity factors, this technique could also provide a means of 

''19 " 
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predicting a given individual's support or Goramittmient ^oward a particular 



\ 



factor. ^ 

\ - ^ ' 

This study also seems to indicate that there ma"'^.^be some danger in one 
group(either status oV algorithm) focusing on one cluster of factors as most 
essential in pronioting instructional development. The analysis of responses,, 
to the IDC manipulation weighted factor ranks supports this view. If a group 
views its authori^:y as only being able to manipulate factors within the IDC, 
then that* group can become primarily conperned with issue\^such as staff size, 
skills, quality of produce^. " Nqne of ;^these factors, however^ are considered 

very important in 'the administrative- manipulation weighted factor ranks. An 

\ * ^ ■ L ' ' 

IDC that concentrates on th^se factors a-lone, without concern for external v 

administrative policy and campus attitudes may find itself isolated and with- 

' out the support of administration of faculty. 

In summary, the factors that influence instructional developme^" in * ^ 

higher education appear, in the sample chose, to be largely determined by the: 

**concerns" of the individual respondents. The factors cluster together in 

line with thes-e concerns. QroUps identified through the algorithm in this 

study vtended to ""have more consistency in favoring specific clusters of factors 

than did. traditional groups defined b^Xj^ademic status. The development of 

a model to both define key factors and demonstrate inter-relationships b4tween 

factors that can facilitate instructional development has been suggested. The* 

chief problem in defining ^ such model lies in the shifting focus of' concern 

depending upon the viewpoint' of any^^individual in relation to his/her role in 



the instructional development prodes^.i In the meantime, however, an awareness 

of the main factor clusters and of how c^e ID staff, faculty and administration 

/ 

view their role in the ID proce&s can be achieved by the technique's described 
in this study. Top priority factors demonstrated in this study were seen as 

I 
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those in cluster 1: administration's support through budgetary support, the 
placement of the IDC ii^^ the institution's hierarchy, and rewards for faculty; 
and IDC related 'factors such as the skills. of the staff, Director, and the 
q^uality of the products produced. 



/ 
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Table 1 


Clusters of factors 


grouped on the jDas^s 


^-t5f factor rank^. 


Cluster 


Type 


Factor jFii^^bers (ref 


to appendix C) 


1 


Administrative 
and staff 


1 .2 4 8 12 iS 20 




2 


policy toward 
instructional 
development 


3 6 10 M 13 




3 • 


Climate ' 


5 7 9 14 18 




4 


Image ^ 


16 17 19 





Tabl^ 2 Significant contrasts oh mean, factor rankings using 
/ the modified least significaj^t dif ferene^__^>^ocedAir^ 



(p=.01) . y 
Factor number Significant contrasts between groups* 



3 


A i^ith 


C; B with C 






/ 


4 


A with 


B 








6 


A with 


c 










\ A with 


B 










\ A with 








1 




with 










'l8 


A with 


Bjb A\ with C 






»•£ 


20 


A with 


C; B with' C 


✓ 





* The letters^, B, C refer to the grouys formed by ^he algori,thm 
and plotted in figures 1 through 4. 
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Figure 8. 
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FACILITATING INSTRUCTTONAL dIvELOPMENT IN HIGHER EDUCATION 



DELPHI PANEL - '\ 

TASK ONE: List below all those factors that you consider imj^rtant in the ^ 
succdssful oper^Uion of an institutiorpal Center for Instructional 
Develapment. l^-eu. may use additional paper, if n^eded.^ . 

\" . ' * \ ; 

OTj^^^pur ,list . is coinple, lfi4icat,e your name and institution at the 
'bo t.taiii*, and* return at your iEjar lies t convenience to:, Dr. Robin 
LaVrason, Media Learning Renter, Temple University (.envelope 
provided) ^ 



\ 



\ 




\ 



Completed by 



Institution 
Position 
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^ /\PPI'NDIX B. 

Pro^iect to/dentify Factofs Influencing Instructional Development in 
f ^ * Higher EducatioiL^ 

Initial results to the first open-enc^ed." questionnaire indicate the following 
factors as being among the most important. Read all these over, and decide which 
you feel is the most important. You may add other factors at* t^e bottom or on' the 
back of this page. 



FIR'ST: RANK the factors in the order y9u;b'er^ve most important in terms of 
^, • makirtg instructional devolopm^ent work on campus (1 mo^t important). 



r;EXT: - RATl^ejich factor ' s .ability- to be manipulated by aif''instrucftipnal develop- 
* ment center. .Use a scale^ of 1' to 5 (little manipulation po/sible to max- 



imum malripulayion possible). 



Factor 




Financial^^stability of the- i-VLsti. 
Administration' & support^^oi^'^^e Center 
Innovational climate" of the institutioji 
ButU:etary support for the Center ^ 
'Opennessof 'fiiculty to' chan;;c 
Rewa»rds provided for f-aculty. for ID work 
Campus image of the ID Center ..^ 

Position of the IDC & Birectoi within institution 

f.kills of the ID Director (ID & .personal) 

Size of the ID staff - ' ' , 

Skills of the ID staff - " / 

Range of IDC services available to fax:ulty 

Prior success record of the iDC 

Quality of the compJ.^ted products 

Continuation of projects started through' 
systematic evaluation and refunding 

Size and diversity of the insititulon' s programs 

Positive' attitudes of students. 



Rank 

Importance 



Ability to be 
manipulated 



Name 



Position 
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appeniJly c 



•...j,., t I., l l. nt lfy l-.i. tors InflucMclni; Instructional Development tn Higher -Educnt Ion 



1 iWi ! fur I I on.) I il<v<- 1 (i|iinctu Is j 
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.oncrallv <l.-ffm'.l .is :\ sysLoin.i t Ic proVoHS 
wlil.li Is r.iplovi'.l In ihc doslun, pijoduot Ion, ;muI cvahi.itlon ol Instructional 
nuiri l.,!.;. Ilu- proioss Involves analysis of rurrlculum r.oals .md objectives, 
U-arner < h.ir.u i erlsl h h, appropr talk.- teaching nietliods, ami optimal learning 



ri'Sutirri'H , 

From your paVticul.ir role wiLhkn the univx^rsity (admi^ist ratals, faculty, 
instructional deveipper, ID RrUduati student etcy) examine the fallowing factors 
which influence the successful operation of instrW tional development in higher 
education. Then... • m • 



SIX ONI) 



I IKST: RAiJK the factors in the order yau believe most important JLn terms of 
ma-k^\p,. instructional development work on campus. Rank factors 1 to 20. 

RAT-: each factor's potential to manipulated by an instructibnal ' 

<ieveit3pment center. Use a scale of * 1 to 5 (1 representing maximum 

mv'inipulatk)n possible, and 5 for a factor that is not easily 

m;inlpuratc*u) . * 

TllIRI): /wii-; each factor again on its ability to be r^nipulated by the 
administration of the university. Use the same 1 to 5 scale. 



Fac torS/.^--^^ 

1.- Skills of the Instructional Development 
Center (IDC) staff 


1. 

Rank 
(1-20) 


2. 

IDC manpltn 
(1-5) 


3. 

admin mar 
(1-5) 


ipltn 


2. Administration's support of ^the^IDC. 










.3. Size & diversity of the academic programs 
offc^rod by the university 










Skills (ID & personal) of the ID director 










5. -I'lnancial stabl/lity of the university 


± 








6. Ejfistence of faculty p dlicy-makihg commits 
_l:.ee(s) ..on operation of /l . D . _s.e^v±Jes7^ 




i 






7. Positive learning attitudes of ^rtudervts^ 










8. Quality ^f the completed instructional" 
materials , - 











9. Academic skills of the faculty 

n 

r 


} ' \ 








IQ. Diversity of service? available to 
faculty through the IDC* 

' " . . 

■ ^ ^ — vA^^^ r; 2- ' 


j. 









V'^yy nt i}m-*Htio\u\\vc on I. !). * ii Higher Fxi, 



.\\ ( • > I 



LI. SUo of II) staff 



12. Position ol the IDC & director within the 
_ heirarcby of the institution , ' 



M. Kocus on long term large scale curriculum 
projects. 



14. lanovational climate of the university 



15. liiulgetary support, for the I.D.C, 



16. Rapid turn ar^unrd time fori da^''^ to day 
instruct iona]^ mater iais production 




17. Carnpu^ image of the I.D.C, 



IH, bpeness of faculty to change' 



i.^. Prior /^access record of the I.D.C'. 



2.0, Kowanls [irpyided for faculty for time 
_ 5i worVs spent oii I^D. activities 



I. 

Kank/ 



TIKI man|>tn- 
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admin .uuinptn 
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\ \!FLEri; FORM AT YOUR EARLIEST hoNVENIElJCE AND RETURN IT mrEDIATELY TO: 



at Temple University: 
Dr» Robin Lawrason 
^^edia Learning Center 
Humanities Building, 



lat Syracuse University 
Mr. •'John Hedb'erg 

Area of Instructional Technology 
Huntington Hall //115 ' • 



APPENDIX D. 
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i!eans Sc^^res and Rankings for Factors 
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IDC manpltn 
mean rank 



Admin manpltn 
mean rank 
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Skills of the IDC staff 
Adni^^tration' s support of the IDC 

Size & diversity of University's prograiri 

■ / 

Skills of the ID director^ 
Financial stability of the university 
Faculty poli,cy making IDC committee * 
-Positive lea^rfing attitudes of students 



ii^s 



Quality of iris t rue tio^al materials 
Academic skills of faculty 
Diversity of IDC services to faculty . 
Size of ID st^^ff 

Position \)f IDC & Dir in hierarchy 
Focus on long term projects 
Innovational climate of university 
Budgetary support for IDC 

Rapid turn around time on daily Productn 

' \ /■ 

\ '' ■■■'/■ 

Campus image of IDC " 

' ■ ' / ■ ■ ■ 

OpeMss of faulty to change 
Prior sur^cess record of IDC 

■ / 

Rfewards for faculty for ID work 



5.37 3. 

3.9 \ 

14. 9-5 20 

■7.73 4 

[ 12.18 13 

13.15 15 
-/ 

.14.9' 19 

8.47 5 



12.95 14 
9.47 10 



14.1 18 

8.6 6 

13.33 17 

8.J6 ' j6 

5.53 2 

13.25 16 

11.63 12 

8.63 8 

10.83 11 

8.88 9 



1 
3 



9.05 
12.33 
61.98 20 
19.9 6 
56.63 18 
34.37 15 
49.3 
11.28 



17 
2 



58.03 19 

18.83 "5 

39.6. 16 

29.43 12 

b.7 14 
28.03^11 
16.68 
21.13 

23.75 ^8 

30.98 13 

26 . 68 '9 

27 .'03 10 



4 
7 



15.4 6 

4.78 1 

28.53 12 

13.1 3 

■29.78" 13 

26,, 93 10 

54.9. 20>^ 

30.13 14- 

33.48 15 

27.43 11 

2^.35 8 . 

/ 

14.08 4 

33.73 16 

18.85 7 

7.28 2 

48.^75 19 

35.98 17 

25.7.3 9 

43.0 18 
14.4 



